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-- The MAILING DATE of this communication appears on the cover sheet with the correspondence address— 

All claims being allowable, PROSECUTION ON THE MERITS IS (OR REMAINS) CLOSED in this application. If not included 
herewith (or previously mailed), a Notice of Allowance (PTOL-85) or other appropriate communication will be mailed in due course. THIS 
NOTICE OF ALLOWABILITY IS NOT A GRANT OF PATENT RIGHTS. This application is subject to withdrawal from issue at the initiative 
of the Office or upon petition by the applicant. See 37 CFR 1.313 and MPEP 1 308. 

1 . Kl This communication is responsive to 06/1 8/08 . 

2. ^ The allowed claim(s) is/are 48-69 . 

3. |3 Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d) or (f). 

a) H All b) □ Some* c) □ None of the: 

1. S Certified copies of the priority documents have been received. 

2. □ Certified copies of the priority documents have been received in Application No. . 

3. □ Copies of the certified copies of the priority documents have been received in this national stage application from the 

International Bureau (PCT Rule 17.2(a)). 
* Certified copies not received: . 

Applicant has THREE MONTHS FROM THE "MAILING DATE" of this communication to file a reply complying with the requirements 
noted below. Failure to timely comply will result in ABANDONMENT of this application. 
THIS THREE-MONTH PERIOD IS NOT EXTENDABLE. 

4. □ A SUBSTITUTE OATH OR DECLARATION must be submitted. Note the attached EXAMINER'S AMENDMENT or NOTICE OF 

INFORMAL PATENT APPLICATION (PTO-152) which gives reason(s) why the oath or declaration is deficient. 

5. □ CORRECTED DRAWINGS ( as "replacement sheets") must be submitted. 

(a) □ including changes required by the Notice of Draftsperson's Patent Drawing Review ( PTO-948) attached 

1 ) □ hereto or 2) □ to Paper No./Mail Date . 

(b) □ including changes required by the attached Examiner's Amendment / Comment or in the Office action of 

Paper No./Mail Date . 

Identifying indicia such as the application number (see 37 CFR 1.84(c)) should be written on the drawings in the front (not the back) of 
each sheet. Replacement sheet(s) should be labeled as such in the header according to 37 CFR 1.121(d). 

6. □ DEPOSIT OF and/or INFORMATION about the deposit of BIOLOGICAL MATERIAL must be submitted. Note the 

attached Examiner's comment regarding REQUIREMENT FOR THE DEPOSIT OF BIOLOGICAL MATERIAL. 
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Art Unit: 2173 

DETAILED ACTION 

1 . The Request for Continued Examination (RCE) filed on 1 8 June 2008 under 37 CFR 
1 .53(d) based on parent Application No. 09/901,275 is acceptable and a RCE has been 
established. An action on the RCE follows. 

2. The amendments filed on 18 April 2008, submitted with the filing of the RCE have been 
received and entered. Claims 48-69 as amended arc pending in the application. 

PROPOSED EXAMINER'S AMENDMENT 

3. An examiner's amendment to the record appears below. Should the changes and/or 
additions be unacceptable to applicant, an amendment may be filed as provided by 37 CFR 

1 .3 12. To ensure consideration of such an amendment, it MUST be submitted no later than the 
payment of the issue fee. 

Authorization for this examiner's amendment was given in a telephone interview with 
Mr. James Love (Reg. No. 58,421) on 26 March 2009. 



4. 



The application is amended as follows: 
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a. Replace the Abstract with the follows: 

A method of controlling network devices via a man-machine interface including 
determining a connection of one or more devices to a network, determining availability of one or 
more multimedia services available via a respective one of the connected devices, and displaying 
a hierarchical view representative of one or more of the connected devices and one or more of 
the available multimedia services. 
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b. The specification is amended as follows: 

i. Replace the heading "Description" at the top of page 2 with the heading — 
BACKGROUND OF THE INVENTION--. 

ii. Add the heading — 1. Technical Field — above line 1 on page 2 (underneath 
BACKGROUND OF THE INVENTION). 

iii. Add the heading -- 2. Description of Related Art ~ at line 6 on page 2 
(Before the start of the second paragraph). 

iv. Add the heading - BRIEF SUMMARY OF THE INVENTION -- at the 
top of page 6 (before line 1). 

v. Add the heading BRIEF DESCRIPTION OF THE DRAWINGS -- at 
line 25 on page 9. 

vi. Add the heading - DETAILED DESCRIPTION OF THE INVENTION - 
at line 14 on page 10. 

c. The claims are amended as follows: 

vii. Claim 48 is amended as follows: 

Claim 48. A method for controlling network devices via a home network, the network 
devices being connected to said home network via different protocol standards, comprising: 

simultaneously displaying generated g e nerating icons of the network devices having a 
plurality of functions regarding a reproducing and/or recording of an audio/video signal, icons of 
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a plurality of services provided by each device grouped according to the type of services 
provided icons of all services corresponding to the devices , and menus including the functions 
which are operable with the associated network device or service; 

at least partially displaying the generated icons with a hierarchical structure so as to show 
a relationship of network connections of the network devices in the home network; 

receiving a selection of a network device or a service by a user selecting one of the 
displayed icons; 

selectively displaying the menu of a selected network device or service, the menu 
including the functions which are operable with the selected network device or service; 

receiving a selection of a function in the selectively displayed menu; and controlling the 
network device or service to execute the selected function based on a respective one of the 
protocol standards, 

wherein the execution of the selected function results in a data stream of an audio/video 
signal stored in a providing network device being sent from the providing network device to the 
selected network device or to a device capable of receiving said data stream via the home 
network ; and 

receiving a user selection resulting from a dragging of one of the displayed icons 
of the plurality of services provided by a corresponding network device and a dropping of 
the icon on an icon of another network device to perform the service corresponding to the 
dragged and dropped icon on the another network device. 



viii. 



Claim 5 1 is amended as follows: 
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Claim 5 1 . The method according to claim 50 4&, wherein at least partially displaying the 
icons with a hierarchical structure further includes organizing the icons according to the kind of 
sub-networks connected to said network. 



ix. Claim 55 is amended as follows: 
Claim 55. A controller including a man-machine interface for controlling network devices vi 
a home network, the network devices being connected to said home network via different 
protocol standards, comprising: 

means for simultaneously displaying generated g e nerating icons of the network devices 
having a plurality of functions regarding a reproducing and/or recording of an audio/video signal, 
icons of a plurality of services provided by each device grouped according to the type of services 
provided icons of all services corresponding to the devices , and menus including the functions 
which arc operable with the associated network device; 

means for at least partially displaying the generated icons with a hierarchical structure so 
as to show a relationship of network connections of the network devices in the home network; 

means for receiving a selection of a network device or service by a user selecting one of 
the displayed icons; 

means for selectively displaying the menu of a selected network device or service, the 
menu including the functions which are operable with the selected network device or service; 
means for receiving a selection of a function in the selectively displayed menu; and 
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means for controlling the network device or service to execute the selected function 
based on a respective one of the protocol standards, 

wherein the execution of the selected function results in a data stream of an audio/video 
signal stored in a providing network device being sent from the providing network device to the 
selected network device or to a device capable of receiving said data stream via the home 
network ; and 

means for receiving a user selection resulting from a dragging of one of the displayed 
icons of the plurality of services provided by a corresponding network device and a dropping of 
the icon on an icon of another network device to perform the service corresponding to the 
dragged and dropped icon on the another network device . 

x. Claim 58 is amended as follows: 

Claim 58. The controller according to claim 57 S&, wherein means for at least partially 
displaying the icons with a hierarchical structure further includes means for organizing the icons 
according to the kind of sub-networks connected to said network. 

xi. Claim 62 is amended as follows: 

Claim 62. A computer readable storage medium having computer readable program code 
stored thereon for causing a computer to provide a man-machine interface for controlling 
network devices via a home network, the network devices being connected to said home network 



'\J Sjp* v * v 
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via different protocol standards, the computer readable storage medium comprising executable 
instructions that cause a computer to: 

simultaneously displaying generated g e n e rat e icons of the network devices having a 
plurality of functions regarding a reproducing and/or recording of an audio/video signal, icons of 
a plurality of services provided by each device according to the type of services provided, and 
menus including the functions which are operable with the associated network device or service; 

at least partially display the generated icons with a hierarchical structure so as to show a 
relationship of network connections of the network devices in the home network; 

receive a selection of a network device or service by a user selecting one of the displayed 

icons; 

selectively display the menu of a selected network device or service, the menu including 
the functions which are operable with the selected network device or service; 

receive a selection of a function in the selectively displayed menu; and 

control the network device or service to execute the selected function based on a 
respective one of the protocol standards, 

wherein the execution of the selected function results in a data stream of an audio/video 
signal stored in a providing network device being sent from the providing network device to the 
selected network device or to a device capable of receiving said data stream via the home 
networ k; and 
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receive a user selection resulting from a dragging of one of the displayed icons of the 
plurality of services provided by a corresponding network device and a dropping of the icon on 
an icon of another network device to perform the service corresponding to the dragged and 
dropped icon on the another network device . 

xii. Claim 63 is amended as follows: 

Claim 63. A method for providing a man-machine interface for controlling network devices 
via a home network, the network devices being connected to said home network via different 
protocol standards, comprising: 

simultaneously displaying generated generating icons of the network devices having a 
plurality of functions regarding a reproducing and/or recording of an audio/video signal , icons of 
a plurality of services provided by each device grouped according to the type of services 
provided, or to a device capable of receiving said data stream and menus including the functions 
which are operable with/by the associated network device/service; 

at least partially displaying the generated icons with a hierarchical structure so as to show 
a relationship of network connections of the network devices in the home network; 

receiving a selection of a network device or service by a user selecting one of the 
displayed icons; 

selectively displaying the menu of a selected network device or service, the menu 
including the functions which are operable with[[/by]] the selected network device/service; 
receiving a selection of a function in the selectively displayed menu; tmd 
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controlling the network device or service to execute the selected function based 
on a the respective one of the protocol standards standard^ 

wherein the execution of the selected function results in a data stream of an audio/video 
signal stored in a providing network device being sent from the providing network device to the 
selected network device or to a device capable of receiving said data stream via the home 
network; and 

receiving a user selection resulting from a dragging of one of the displayed icons of the 
plurality of services provided by a corresponding network device and a dropping of the icon on 
an icon of another network device to perform the service corresponding to the dragged and 
dropped icon on the another network device . 



Claim 66. The method according to claim 65 63-, wherein at least partially displaying the 
icons with a hierarchical structure further includes organizing the icons according to the kind of 
sub-networks connected to said network. 



xm. 



Claim 66 is amended as follows: 



Allowable Subject Matter 



5. 



Claims 48-69 are allowed. 
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6. The following is an examiner's statement of reasons for allowance: The present invention 
teaches controlling various kinds of home network devices via a man-machine interface. Each of 
the independent claims identifies the distinct feature of receiving a user selection resulting from a 
dragging of one of the displayed icons of the plurality of services provided by a corresponding 
network device and a dropping of the icon on an icon of another network device to perform the 
service corresponding to the dragged and dropped icon on the another network device. The 
closest prior art, Microsoft® Windows (hereinafter "Windows"), copyright 1998 (Scrccnshot 1) 
and Wendorf et al. U.S. Patent 7,257,821 (hereinafter "Wendorf ') teach an interface that displays 
a hierarchical view of home devices connected to a home network. In the case of the Windows 
reference, Windows teaches generating icons of the network devices having a plurality of 
functions regarding a reproducing and/or recording of an audio/video signal and menus including 
the functions which are operable with the associated network devices (Screenshot 2 shows the 
display of a plurality of icons representing devices that are connected and available to the 
computer network, for example, an Audio CD player that is capable of reproducing/playing 
audio CDs); at least partially displaying the generated icons with a hierarchical structure so as to 
show a relationship of network connections of the network devices in the network (the icons 
representing the devices are shown in a hierarchical tree display in Screenshot 2; each of the 
devices have a menu of available functions associated with it, as shown in Screenshot 3, that can 
be shown by right-clicking on the device icon); receiving a selection of a network device by a 
user selecting one of the displayed icons (for example, selection of the Audio CD device icon, as 
shown in Screenshots 3 and 4); selectively displaying the menu of a selected network device, the 
menu including the functions which are operable with the selected network device (a menu of 
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available functions such as "Play" are displayed upon user selection via right-clicking the 
corresponding device icon, as shown in Screenshots 3 and 4); receiving a selection of a function 
in the selectively displayed menu (users can select any of the functions displayed in the menu 
shown in Screenshot 3, such as the "Play" function); and controlling the network device to 
execute the selected function (the network device, i.e. CD player will execute the function of the 
playing the CD upon selection of the "Play" function in the menu shown in Screenshot 3), 
wherein the execution of the selected function results in a data stream of an audio/video signal 
stored in a providing network device being sent from the providing network device to the 
selected network device via the network (upon user selection of the "Play" function, the selected 
network device of the Audio CD player will play the data stream, i.e. a particular track selected 
on the providing network device, i.e. the computer, as shown in Screenshots 6-8). In the case of 
the Wendorf reference, Wendorf teaches controlling home devices connected to a home network 
based on a respective one of different protocol standards (the communication system of the in- 
home network operates the in-home devices using predetermined home protocols) (Wendorf: 
column 1 : lines 40-49), and wherein execution of the selected function results in a data stream of 
an audio/video signal stored in a providing network device being sent from the providing 
network device to the selected network device via the home network (a user can program his 
home VCR from his remote office PC, i.e. data signals are sent from the user's office to the 
user's home network) (Wendorf: column 1, lines 12-17). However, the prior art fail to teach 
performing a selected service that is grouped according the type of service provided by one 
network device on another displayed network device via a drag and drop operation; therefore, the 
prior art fails to teach the limitation of receiving a user selection resulting from a dragging of one 
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of the displayed icons of a plurality of services provided by a corresponding network device and 
a dropping of the icon on an icon of another network device to perform the service corresponding 
to the dragged and dropped icon on the another network device. Thus, the prior art fails to 
anticipate or render the above limitations obvious. 

7. Any comments considered necessary by applicant must be submitted no later than the 
payment of the issue fee and, to avoid processing delays, should preferably accompany the issue 
fee. Such submissions should be clearly labeled "Comments on Statement of Reasons for 
Allowance." 

Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to TING ZHOU whose telephone number is (571)272-4058. The 
examiner can normally be reached on Monday - Friday 8:00am - 5:00pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Kieu Vu can be reached on (571) 272-4057. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, sec http://pair-dircct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would 
like assistance from a USPTO Customer Service Representative or access to the automated 
information system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 



/Ting Zhou/ 

Primary Examiner, Art Unit 2173 



